Web Survey Bibliography
Title Web Surveys Versus Other Survey Modes: An Updated Meta-analysis Comparing Response Rates
Author Wengrzik, J.; Bosnjak, M.; Lozar Manfreda, K.
Year 2016
Access date 01.06.2016
Abstract
The aim of this meta-analysis is to update a previous meta-analysis by Lozar Manfreda et. al. (2008), synthesizing experiments published between 1998 and 2005 on response rate differences between Web and other survey modes. Based on 45 experimental studies identified, Web surveys yielded 11% lower response rates on average compared to all other modes. Furthermore, substantial variability around this average effect size was discovered, which could have been partially explained by the sample recruitment base, the solicitation mode and the number of contacts. Other factors as the type of mode web was compared to, type of target population, sponsorship, publication year or incentives showed no significant influence in this previous study. However, the original study by Lozar Manfreda et. al. (2008) faced a statistical power problem due to small numbers of observations for certain moderator levels. Since 2005, numerous studies carrying information about response rates differences between Web and other survey modes have been published. Consequently, we seek to address the following research questions in our update:How robust are the previous findings over time? Do web surveys still yield lower, the same, or even larger response rates? If we still detect any effects, which factors influence response rate differences? To identify studies published after 2005, we used the same eligibility criteria employed by Lozar Manfreda et. al. (2008) and have identified 94 experimental comparisons altogether, extracted from 57 papers. The overall findings indicate a remarkably robust response rate difference over time (12% lower response rates for Web surveys on average). Moreover, because of the increased number of primary studies, we were able to get more accurate estimates for all moderator variables (type of comparison mode, sample recruitment base, target population, sponsorship, solicitation mode, incentives, number of contacts, publication year) considered. Practical implications and avenues for future research are being discussed.
Access/Direct link Conference Homepage (abstract)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Bosnjak, M. (25)
- Article Establishing an Open Probability-Based Mixed-Mode Panel of the General Population in Germany...; 2017; Bosnjak, M.; Dannwolf, T.; Enderle, T.; Schaurer, I.; Struminskaya, B.; Tanner, A.; Weyandt, K.
- Does Changing Monetary Incentive Schemes in Panel Studies Affect Cooperation? A Quasi-experiment on...; 2016; Schaurer, I.; Bosnjak, M.
- Web Surveys Versus Other Survey Modes: An Updated Meta-analysis Comparing Response Rates ; 2016; Wengrzik, J.; Bosnjak, M.; Lozar Manfreda, K.
- The Effects of Questionnaire Completion Using Mobile Devices on Data Quality. Evidence from a Probability...; 2015; Bosnjak, M.; Struminskaya, B.; Weyandt, K.
- A quasi-experiment on effects of prepaid versus promised incentives on participation in a probability...; 2015; Schaurer, I.; Bosnjak, M.
- Unplanned use of mobile devices in a probabilistic online panel survey: Patterns of use and implications...; 2015; Poggio, T.; Bosnjak, M.; Bandilla, W.; Weyandt, K.
- Survey participation via mobile devices in a probability-based online-panel: Prevalence, determinants...; 2014; Poggio, T., Bosnjak, M., Weyandt, K.
- Switching the polarity of answer options within the questionnaire and using various numbering schemes...; 2014; Struminskaya, B., Schaurer, I., Bosnjak, M.
- Sample composition discrepancies in different stages of a probability-based online panel; 2013; Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W., Couper, M. P.
- (Online) Access Panels: Types and Quality Standards; 2012; Bosnjak, M.
- Mobile Survey Participation Rates in Commercial Market Research: A Meta-Analysis; 2012; Bosnjak, M., Poggio, T., Becker, K. R., Funke, F., Wachenfeld, A., Fischer, B.
- Self-administered mobile surveys; 2011; Bosnjak, M.
- Use of new technologies in social research: Self-administered mobile surveys; 2011; Bosnjak, M.
- Self-administered mobile surveys: Usability and (non)participation; 2010; Scherrer, S., Bosnjak, M.
- Internet surveys; 2010; Couper, M. P., Bosnjak, M.
- Web Surveys; 2009; Bosnjak, M.
- Understanding the willingness to participate in mobile surveys: Exploring the role of hedonic, affective...; 2009; Bosnjak, M., Metzger, G.
- Measurement options, measurement error, and usability in mobile surveys; 2009; Pferdekämper, T., Bosnjak, M., Metzger, G.
- Compensating for low topic interest and long surveys: A field experiment on nonresponse in Web surveys...; 2007; Marcus, B., Bosnjak, M., Lindner, S., Pilischenko, S., Schuetz, A.
- Beyond response rates: Effects of different (Web-) survey implementation procedures on sample composition...; 2006; Bosnjak, M., Marcus, B., Schuetz, A., Lindner, S., Pilischenko, S.
- Survey Administration Effects? A Comparison of Web-Based and Traditional Written Self-Administered Surveys...; 2003; Bandilla, W., Bosnjak, M., Altdorfer, P.
- Understanding the Willingness to Participate in Online-Surveys - The case of E-mail questionnaires; 2002; Bosnjak, M., Batinic, B.
- (Non)Response bei Web-Befragungen; 2002; Bosnjak, M.
- Banner-advertised Web surveys; 2000; Tuten, T. L., Bosnjak, M., Bandilla, W.
- Current Internet science - trends, techniques, results. ; 1999; Reips, U.-D., Batinic, B., Bandilla, W., Bosnjak, M., Graef, L., Moser, K., Werner, A.